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In 1975-76, an outreach activities corponent enabled 
B2PSAC (a highly successful early childhood bilingual intervention . 
prograa) to provide replication services to various local education 
agencies requesting such services. Training Was taken to, the 
replication centers by a specially designed alad equipped aotor coach. 
During the year, the Fort Suaner, Artesisf, and Cdrlsbad {Hew Mexico)^ 
school districts requested replication services. ^IB addition, the * 
Clovis-Portales Bilingual Early Childhood Program aade rejplication, 
with training sites in Clovis and Portales. Teachers and aides were 
trained through visits by the outreach training teaa and a workshop 
at ^t&e parent center. Evaluation was conducted viay objective ^ . 
evaluati^ons^^of the foraal course; classroon visits; site-visits with 
adainistral^brs, teachers, and aiides; self-evaluation questionnaires 
f roa the trainees and. trainers; and a review of various records/logs 
.^maintained by the outreach training teaa. A follow-up of former 
*BEPSAC students ip grades 1-4 'was conducted. Findings included: 
'teachers gained a good understanding of hajidi capping conditions and * 
of. how to adequately screen their children; the 'training workshop .had 
a positive effect on* the participants' teaching behavioj; and the 
.follo»-up study indicated a downward trend .for Spanish language 
developaent, a slightly upward trend for English language 
development; and a rather stable trend for learning aptitude.. (HQ) 



•effort to^Sn ^ ^^^J^u"^"^' ^^"^ unpublished materials ndt available from other sources ERIC makes every 

fX of Si^^^ Nev^theles,, items' of marginal reproducibility are often encouS«eTand S^^^ 

eS^^Ic Jl^S . i hardcopy reproductions 'ERIC makes available via the ERIC Document Revxoducdon S^^^) 

^e^Ji ^^^«^^' Reproductions nxpplied by EDRS are iTl^^S^c^S^^^^ 



AJL<^ /-Z^ G 



^ . EVALOAT ION REPORT' 
Nov. 29, lS74-Junj& 30, 1976 



us OC^AtmewTOlf^MEALTH. 
EDWCATIW* *WtLFAtC 
NATI0MA4. IWSTITUTC Of 
COUCATIDM 



» TK.S DOCUMENT «|f;„"|^^ 

' tTATEO'OO »*OT NECESSARILY SE^PRE- 
EOuCiT'ON POSITION Oa POi.»CY 



OUTREACH ACTIV.ITIES {Replication Services) \ ' ^ ^ 

of the * . • ' v^' 

RESPONSIVE ENVIRONMENT PROGRAM IFOR SPANISH Af^ERlCAN CHILDREN .(REPSAC). 



Funded by: A^'- * / 



Handicapped ttrildren's £arly^\Ediccktion Program 
Bureau of Education for the 'HaJoif:apped , ' 
• U.S. Office of Education 
Grant Number GOO-75-00079 ^ / 

Under contract with: ' 



/ 



CTovis Municipal Schools 
800 Pile Street -Xv 
plovis, jt^ew Mexico . • //; , 



* » 



. - Prepared by: 

^,, '8. E. Askinsr and':Associates 
\ -Box '4234; Texas Tech Station 
{K . Lubbock:,,, Texas 79409 

%■ \ June, 1976.^ -. . 

(■ . ■ 



CLOVIS MUNICIPAL^CHOOLS 

apard of Education ^ . " * • 

, Dr. JacoVMoberly-, President 

Hr. Harry Easraan Kj. Billy I^eal WilliamA 

Mr. Wilbur Johnson ^ ^ Mr. Charles Guthals \ 

% • * 

Dr. L. W. Byous, Super inte'ndent 

' Mr. Davnenport Beasley, Assistant Superintendent 

hfesibers of ^ the Professional Advisory Board i 

Dr. Gilbert Delgado, D^ean • Mrs. Oral'ie McAfee 

Graduate School ^ ' Early Education 

GaljLaudet College Metropolitati State Colleg 

.Washington, D. C. . Denver Color'ado 

Mr. Henry Pascual, Director' \ Mr. ferry Wugalter, Chief 

Bilingual Jeacher Training Unit <; Public School Finance h. 

State /Department of Education / < ^ -Secretary for Education. 

Santa/F^, New Mexico- ' ^ - ^ . State Capitol Building 




t ^tuve. Executive Director 
^ Association for Retarded Citizens 
qiie. New M^ico ^ 



Santa Fe, New Mexico 



Facility/Staff of Oycreach Activities 

■ • 

Mr;s, Gay Herman, Director 



/ 

/ 



/ 



Mr^. Ruth Holland, Ass&giate Dj.rectar 6 \ *.* 

Outreach Coi^syltant/E^r ly ChildhoocJ^ \ . 

Ml-sr Kll^abeth Bi*aselL, .gutre^ch Consult tant /Educational Diagnqstician & 
, ' 'Xanguag,e Specialist 

V - -• - \ • - • -- . ■ 7 

Mrs. -Susan Leone, Outfeach Consul tant/Sp'eech Therapy . * / 

"■^ . • 
Mrs. TaUsbee Knight, Sed^etary . ^ * . > * 

* ^ ^* ^ » • 

^ <^ EVALUATION TEAM M'DdBERS : , ' \ ' 

' * *- * * ' ^ ' ' ^ ' . ' 

Dr. Billy, E. Askins, Coordinator of Evaiciation and Research 

' * ' ^ * 

Dr. Joe D. Cornet t, Jlesearch Associate ' 
Dr.' Len Al^sworth, Consultant ^ * . , 

Dr.. Ralph Cartet, Consultant/Tjestor \ ' j/ • ' ; 

Dr. Frank BlodmeVj Consultant y • / 

H^-s.'Gr^ce LeMojnds, Testor . ^ ^ • ^ ^ ^ 

Mrs. Prankie Cocjk, Secretary /Administratlv'e Assistant/ 



ABSTRACT 



* OUTREACH- ACTIVITiE^ (Replication Service) OF THE RESPONSIVE- 
ENVIROIiHEHT PROGRAM FOR "SPANISH AMERICAN CHILDREN (REPSAC), 
END OF YEAR EVALUATION REPORT, 1975-76 * . 

' Asltinsv Billy E/et al " ' • . • ' 

^ . Beginning with school year 1975-76, an outreach activities component 
was added to the Responsive Enviroriraent Program for Spanish American Chil- 
dren (REPSAC)o a highly successful early childhood tilingual intervention 
program conducted by the Clovis l-tunicipal ScKools, Clovis, Hew Mexico. This 
outreach component gave the program the capability of providing replication 
services to various local education agencies requesting such -services. A * 
unique _ feature thts'^repl i cation service was the capability of taking 
'tlie Vaining io the replication centers by a specially desjgned and- equipped 
motor'^ach, the Mobile Learning Resource Center. 

Thr^e school districts, all in isolated areas and having a large number 

\ • • ' - 

of target children, requested replication services during 1975-76. These 

school districts were: Forf'Sumner; Artesia; .and Carlsbad,-are located in 

eastern New Mexico. In addition, replication by two other scfiool districts 

had^already be^ completed. This^replication was made by the Clovis- 

Portales BilingiAl Early Childhood Program {ESEA-Title Vll) with a training 

. - \ . ' . • / ^ • 

siie in each scholV district (Clov'is and Portales, New Mexico). 

\Training was 4t*ovided to teacher's and aides at ^th^, replication center 



as welWs at the parent center, in "the form of vijsi^^^by the outreach 

- \ ' • ' ' 

training team using the ^fobile Learning Resource Ceht^r and by conducting 

■• \ ^* • * . • 

a workshofX at the paYint center. • ^ !' ' • 

V \ • 

. The evaluation desijn of the trailing function mainly •consisted of- 

. ' N • \ ' ' ' ' . * ' . 

various reseafch/evaluavion questions. To answer .these questions, a . 



yariety of measures were\used which included: objecti\/e evaluation of the 
formal^ course; classroom Visits using a specifically designed classroom 



observation formj site-visits with administra1jerr|^ teachers, and aides; 
self-evalaation questionnaires from the trainees and trainers; and a ' ^ 
review gf various types of records/logs maintain^ by the dWtreach training 
team. In addition, .this evaluation study consisted of a follow-up of 
former REPSAC. students who/were, this,j^e'ar, tn .grades 

^^Major findings included: Teachers trained at the replication • 
centers had a good understanding of handicapping conditions and knew . 
how to adequately screen their children; (2) The training workshops con- 
ducted at the parent center had a positive effect on the teaching behavior 
of the participants as well as being considered^ extremely effective by 
the participants; (3) The motor coaches effectively used in the training 
program; and (4) The follow-up study of former REPSAQ students who were, 
this year, in grades- 1-4 indicated that the trend set in terms of past 
performance ts departing substantially. from the expected growth pattern 
toward a dov/nward trend for language development in Spanish, a slightly 
upward ''t rend for language development i*n English, and a* rather stable 
trend for learning aptitude (IQ). . • . 
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TRODUCTION 

This report describes an extd*nal evaluation study ot the Outreach 
Activities of the Responsive Envfronmeat Program for Spanish American Children 
(REPSAC), Clovis Municipal Schools, Clovis, New Mexico during .the 'period Novem- 
ber 29, 1974-June 30, 1976/ ^/Tb-is report is part of a continuation evaluation 
study being corfducted by B/t. Askins and Associates which is an independent 
consultant and service organization with its direction primarily through various 
facuHy members of the Caileg^e, of Education Texas Tech University. This report 
is submitted in accordance with the approved revised Evaluation Proposal dated 
October 10, 1975 and the Educational Evaluation Agreement dated October 17, T975. 



The Parent Center t REPSAC ^ > 

The major purpose of REPSAC is to serve as an effective early educational 
intervention for 3-, /4-, and 5-year-old ."high risk" Spanish American children 
living in the area served by the Clovis Municipal Schools, Clovis, New Mexico. 
Children are considered "high risk" as a'^esuTt of their low birth weight-, 5% 
pounds] or. less, and v/ho will probably have accompanying handicaps'as they enter 
the first /grade. This program attempts to demonstrate that such an early inter- 
venyioh ca!n provide such children .the experiences necessary, to succeed and 
remain inyjthe educational mainstream. 
: / 

' * RtPSAC, , which has bedn opera*^'ng since September, 1971,* is a group educa- 
tioftat pfogram- as contrastecl to an individual clinical project. 'The program 
aims at /providing successful "experiences using the .concept of responsive en- 
vironme/it for Spanish American.. children in the areas of developing language 
abflitv in English and Spanish and in improying cognitive and affective dev/eU, 
opmentj ^ RE PS AC is considered a demonstration project and, in developing, has 
drawn- /Tieavily uppn three experimentally develpped models in early d\ildho6d 
educdiion: Ihe New I^Jursery School: tlie responsive environment concept and pro- 
ject /LIFE (Language 'instruction to Facilitate 'Education). . Also, the Piaget- 
Earl^ Childhood Curriculum (parts translated --in Spanish) are used. 



Purpose of the Outrea.ch Activities Cojnponent 



" The purpose of adding the ou.treach activities comp'onent to the parent 
^,center (REPSAC) was' to give the program the capability of providing replication 



\;'Jf . " ^-J i-t, .*For references pertaining -to the first, second, third, andj'ourth years 
,J/\:\^l::/ o^^^ see B1>1iography^ (4/ 5, .6, and 7).^ r ' / 
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services to various ^locaT* education agencies requesting such services. A 
unique .feature of this replication servicers the -capability of taking the 
training to fBjjrepl icati^ centers t)v a specially designed .and equipped 
motor coach. ^ ^' . \ 



The outreach component was implemented in two phases. The first phase ^ 
consisted of needs assessment and developmental planning (November 29, 1974^- 
August 31 , 1975), djr\d the second phase consisted of the implementation pro- 
cedures (September 1 , 1975-June 30, 1976). ^ 



three school districts, a 
of target children and within 
guested replication of all or 
'school year. These school dis 
all located in easterr> New Mex 
districts had already been mad 
replication was made by the CI 



11 in isolated areas and having a large number 
a reasonable distance of the parent center, re- 
part of the REPSAC curriculum during the 1975-76 • 
tricts were: Fort Sumner, Artesia, and Carlsbad, 
ico. In addition, replication by two, other school 
e completing their third year of operation.* This 
ovis-Portales Bilingual Early Childhood Program 
i.ng site in each school district (Clovis and 



(ESEA, Title VIJ) with a train 
Portales, N^v Mexico). 

The outreach activities component is designed to have three major functions 
advisory and trsinivfg\ diffusion, and evaluation. 

• Advisory and Training ^ ' - 

This function pertains to staff, development of faculty at the replication 
sites as well as at the. parent center. This involves the training of teachers 
and teacher-aides to acquire competencies in working with young, high risk, and 
handicapped children using the' concept of resppn^sive efivironment'. ^ The training 
team consists of specialists in the area x>f special education; speech therapy, 
early childhood education, and bilingual education. } 

Diffusion ' • 

*The. parent center operates as a service and demonstration center for the 
\state of New .Mexico and parts 'of West Texas. Workshops and conferences vjere 
leld so as to provide information to administratqrs, .agency heads, ^tat.e school 
Officials, and other decision-majcers concerning .^he program and its offerings. 

' Eval uation. 

Evaluation of the out/each activities Was conducted internally and exter- 
naUy, The internal evalutition v/as conducted by the. director and staff of 
REP5AC, and the extgrnal Evaluation v/as conducted by an outside evaluation team 
as previously described. Although the external evaluator is not located spec- 
ifically in the C.lovis, New Mfexicg jar^a, the proxiinity of Lubbock (Texas) to 
Clovis is such pat^fr&quent contact can be made with 'REPSAC and the replication 
centers. / : • • . ' / 

\ i ' . "' ' ' : \ 



* For references pertaining td t'h^ evaluation of this program, see Biblio- 
graphy (8, y, and 10). / . . \ ' " , . - ■ ^ 
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'Purpose of the External. Evaluation 



The purpose of th^' external' evaluatiori is to collect -and provide informa-- 
tion necessary for de^fision-making relative tp the*Qb3ectives of the outreach 
' activities component^' This external evaluat'ion is .considered a way to improve? 
therefore," much "emp^as^is, was placed upon forinative ".^valuation, procedures. 

Major elemej)t^/pf the external evaluation 'were: ' ' ^ • 



1. PrDviding. a Wiety of professional personnel appropriate to the 

evaluatipn of t:he outreach activities including: personnel to adminis- 
ter su/vey instruments, perform site-visits, providing feedback. to the 
training staff, analysis; report writing, and coordination. * > 

2r^evelSpTrTg ancl following the evaluation design for each of the tv/o / - 
pxP^^y functions of the outreach aptivities component - advisory and 
training and diffusion. (The evaluation design for each function is 
described later). : . - * 

3. 'Continuing the follow-up study of former REPSAC students who were, ' ^ 

during school year 1975^-76,^ in the. first,, second, third, and fourth 
grades. " ) 

4. Analyzing data collected q^nd subject data, when appropriate^ to ' 
statistical treat?nerit which will include summaries of data and 
narrative description of 'findings. • . a . • 



5. 



Prepa^ng \wo interim and the end-of-year evaluation reports.' 



\ 



\ 
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SECTION 11 
EVALUATION DESIG 




The external evaluation of tte outreach activities consisted of forma-^ 
tive and summative types of evaluation of ttje two primary functions., advisory 
and training function and the diffusior/fuhctTtm^, Also, as>art of the eval- 
uation of the outreach activities, a follow>ap stiSdy of former REPSAC students 
is being conducted as they progress through variou| grades (1-6) in public and 
private schools'. 



The evaluation design for each of these areas 



ing paragraphs. 



j4 describedljn the. follow- 



Advisory and Training Function 



The major goal of thisVunction' w^s to 
the replication centers to acquire certain ^ 
more effective v/hile working with young, lii 
able children using the concept and process 



assist the teachers and aides at 
nowledge and skills so as 'to be 
'hTisT<, tiandipapp^d, and vulner- 
of responsive environment* 



Fleeds Assessment" 
* 

The first step in imp>emen1 
to'^'work with the communities, paren 
tion/trust and assess traijynftg" need 
to design and' implement a training 
I participants. A training needs ass 




the advis^h;y and trTTmlng fupction was 
and facurty/staff to develop-cooper-a 
genera^y. secure information so as 
sens-itive to^the needs of the 
of the participating personnel v/as 





\ ^nduct ed during August September," 1975. 
Research/Evaluatio n Questions • ~~ \ 

As an element of the ^valifcttion of this training, .the director and 
teachers who conducted the^training posed several questions they^ wanted an-^ ' 
swered durinq/after thq training which Included: 

What kind of rapport exists between personnel at' the repli/:atTon ^| 
centers witli^the training staff? ' , ' ^ ^'ir 



1. 
2. 

4. 



Are the teachers being supported. in their efforts by their 
Ladmi ni strati on? i » 



Do the. teachers"/ have^ adequate av.ailabil ity of profess ional,^ * |; ■> 
materials in thfe areas of bilingual and earl.y''Childhpod education? | 



■f 



Hov/ effective via s. the teaching of the 17 instructional units of 
the course in Concept Development in Early Childhood? ■ 



•5. Are the,teach?rs using the responsive environment a?j\cept in 

their tlachfng including flexible room arranganents and letrning 
centers? - • - 

* • > 

.6. Do the teachers have'ai knowledge of handicapping conditions? 

7. ^ Do t*he feachers know how to screen children? ■ 

8. How effective v;ere the training v/orkshpps conducted at the model', 
center? -. * * ^ . 

9. Are the~teacher-aides effective in their role in the classroom? • 
10. Vtes the motor coach util.ized effectively in the training program? 

. Procedures 'to Collect Data ^ 

a' variety of measures was used to collect -data to evaluate and answer 
the j:€sear<:h questions pertaining to thei^ffects|>f the traiaing. These , 
in^tuded evaluation of the training^'WorKfhopt; art objective .test over tft-6 
cofrse in '{Concept Development in Early Childhood^ classroom visits <Kip- 
dehgarten- classes only) usingja specif ically designed xTassroom observaj^ion 
form:. sife-\4isits with administrators7/teachers, aa<* aides;" self-evaluaoion 
reports "from the trainees"; afid a review of various types, of records/logs 
maintained by the training staff. • . 

. Evaluation of. Workshops .. Various .in-service training workshops were 
conducted during the school yeaV for teachers and teaoher-alides fr.om the 
replication centers as well as the parent center. The prtJcedure for evalua- 
' ting the workshops consisted of 1) ass£ss\nent af the wbrksliop goals/objectivi 
by the method of participant reactipn/response, and 2) observation .of the 
activities of the ffrkshop by the eyaluatbr. Jhe ipstrument used' was . the 
HcCallon Workshop Ev&fua£ion System,*' This instrument, which was completed 
at the conclusion of each wo'rkshop,. solicf.ted participant reactions lo the 
worJJshop on seven din/ensions which were: Organization "of the Workshopj^ Objec 
tlvfis of. the Workshop, Presehtors: Content (ideas.,and activities);. Scope . 
(cpyerage); Benefft; and Ovengl.l Effectiveness, the participants responded 
to questions on each of the s'even dimensions on th& V/arkshop Evaluation 



" *The McCallon Workshop Evaluation" System t.s published by Learning Con-' 
cepts, Inc., Austir|, Texas; f 



Scale (1- poor to 7= excellent). The HcCalloa Worksftop Evaluation System 
provides normative data, and* the participant feedback scores are compared 
against these norms so as to. have reliable analysis and interpretation of 
effectiveness.. The evaluation results were presented iwthree ways.^ The 
results .of the observations of "the v/onkshop were presented in .narrative 
form, and the results of the Workshop Evaluation Scale were reported in 
tv/o forms, tabular and on the Workshop Analysis Report Form, The evaii/a- 
tion data jof each workshop were reported in a separate report and was sub- 
mitted to the project director. 

Objective TesF . An objective t-est over the 17 instructional units of 
the course in Concept Development in Early Childhood was administered as a • 
pretest to all trainees at the beginaing 0ffTtTeNtra>ning and at the end of 
the school year. Statistical analysis of the differences between the scores 
of the posttest and the pretest v/as conducted. 



Classroom Objservations . Members of the evaluation team made periodic 
. classroon visits of partici'pating teachers (Kindergarten classes 'only) to 
observe using a specifically designed classroom observation instrument. The 
'form v/as .designed to note such things as: availabil.ity of bilingual and early 
education materials: learning center^; use of the responsive enyir;onment 
concept; and evidence of long and short range instructional planning. . 

Site-Visits' . iMembers of the evaluation team conducted periodic site- 
visits involving administrators, teachers, and aides so ^s to acqu^'re tfieir^ 
verbal reaction/responses to the training activities. • • 

Self-Evaluation Reports . At the end pf the year, another facet of 
' evaluati6n was in the form of Self-Evaluation Reports so as to. obtain-: 
Administrators* responses (strengths and weaknesses) to the'training acti- 
vities; Teachers' and aides' responses (strengths and weaknesses) to the 
training activities; and Trainers * responses (strengths and weaknesses) to 
the training activites. / - * • , 

Records/Logs . The type of information that v/as obtained -from the 
various records/logs ihcludfed: Number of visits to schools: Number of 
trainees; Number and qualifications of trainees; Type of activities; fi^ter- 
*jfal distributed; Utilization of motor coach --whether coach v/as-used for . 
participant training, screening demonstrations, materials demonstration, 
individual conferences, etf.i Nurhber of teachers trained to screen; JNumber 
,of children screened^ Number of children referred; and Number of childrert ; 
under treatment. , . ' \ , 

Reporting the Data ' ^ ^ \ 

An on-goirig evaluation v/as conducted 'by the evaluatbr, and feedbaek . 
v/as provided to the training staff on a recurring basis' (October, February, 
and April). Thus, evaluation and observation data v/as used to yjeld 
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fomative evaluation results to guide the training staff in selecting con<- 
tent, and instructional procedures. , ^ 

'"•^ Results of the objective tests, cJassroon> observation^ site-visits, 
review of records/logs, and self-evaluation reports are reported later in 
thfs report. 

f 

Diffusion Function 

This .function pertained to the dissemination of information and acti- 
vities of the outreach activities con^ponent. Some means of dissemination 
included: workshops, conferences, preFr^^taion of a commercially prepared 
16 na filn, and preparation of various brochures and reports.^ 

Four v/Drkshops/conferences were conducted as part of this function, as 
well as advis.ory and training function. 

Procedures to/Xollect Data 

The workslpps arid conferences were obje^1«?ly evaluated using the 
McCallon Workshop Evaluation System (instrument v;as previously described). 
^ ^ • , . / ' 

The other dissemination activities were evaluatedyon a subjective 
basis, * ^ ^. 

Reporting the Data 

A separate .evaluation report v/as- sui)mitted to the project director 
after each workshop or conference, and a summary- of each is included in a 
later section of this report; 

^Al SO, .an on-going evaluation v/as Conducted by the .evaluator, and fieed- 
back concerning various diffusion activities were provided to the director 
.and staff on a regular basis (October, February, and^April). Thus, evalua- 
tion and observation data v/ere used to yield. formative evaluation results 
to guide the develODment of dissefj^ination actfvittes. 

Summary objective evaluation data of the worksjiops and conferences and 
the subjective evaluation data of the other activities are reported in. a ' 
later sectton gf this^ report. 

Fol low-Up Study of For^le^ REPSAC Students 

• A basic concern to those who have worked in' REPSAC during the past- • 
.several years'is the status of former students now enrolled in public and 



private schools. This concern has .gener'i^ed a continuation of* the follow-up 
studies of former REP5AC students' which n^te Completed in 197^ and 1975 and 
was conducted at the end of the- 1975-76 'scliool year. - 



Projected Number of Students . " f- 



* 



The projected number of stuvients forr|he°1976 follovA-up study were: 
Grade Level • Estimated tiumbe^ •* ^ 



1 • 20 

2 17 • . 

3 . ■ 16 . 5 . • 

• 4 _2 ■ • r ■ . 

TOTAL 55 ■ -i • 

Procedure For Collecting Data - . " ; 

. , ' / • ' 

The 1976 follow-up study was cortduct^d' using the" following procedures:: 

. 1. Gathering descriptive da^ta^; ; / • . ' 

• ' . ' , \ ' ' ' 

• A questionna>re was submitted 'to teachers of former REPSAC 
students seeking^ information about their academic and social- 
progress ipf^hobl. In addition,, personal interviews were^ 
held v/ith'teachefs and other sdiool -personnel to stipplement 
' the questionnaire data. \ . , 

2. Adniinis4:ering,of stai/idardizad tests/ ' j ' ^ 

Standardized tests w?re a.dininistered tdthk former REPSAr* \ 
students in §ra4e^'2-4. The: tests admtnistered wei^e the 
same instruments used* during the former students^ tenure in 
REfSAC; ther^ore, \ the- test .scores' 'can be. rev'i ewed ^or over^ 
'a span of years bedinnirtg l$7h [ The,,t.^sjts- admifli>tar^^ 
, as fol1ov/s: • ^ 1 ' " ^ ^. .<.v\;;^ ' \ "* 

Peabody- Picture vocabulary' Test - Engl ish' v^5on 

Peabody Picture Vbcabulary Test Spanish vefeMon. 

His^cey-Nebraska Test of Learning Aptitude (IQlV. 

' . ' *• 

Analysis - . ' 

Data obtained from the follow-up study were analyzed in'tv/j?.>/ayfe: '^.^ 

■ ' * -'' ' ', 

i. A de|criptive analysis of the questions and interview ,i?5formatidn. 




- This^anaTysis yielded ^ profile of former REPSAC .students 
^ currently enrolled rn public and private- schools. . 

A*;ti{ne-serjes analysis. - ' * 

This analysis was conducted on the ^test data in 'an effort ^ 
to assess the test score staR^'cS over a; peniod of years. ^ 
The specific eleigent of. the tW--series used in analyzing 
these data was the "secular tr^.". Tttis "line of best fit" 
Hiethod presents a' basis for comMring the theoretical l^rend 
VMth'the observed trend. (The. "Specific program used ts 
described in Statistic Package. for the Social Sciences, ver- 
sion 6/ Texas Tech University Computer Center). . 
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SECTIO«:III ... 
^ EyALUATIOR DATA COfiCERfJING THE ADVISORY AND TRAINING FUSCTION 

The 'advisory and training function pertained to staff development 
primarily at the 'three replication Centers (fort Sumner, Artesia, and Carls- 
bad, Nev Mexico) as v/ell 6S at the parent center. In addition, this training 
assists tv/o other school* districts who, as of this yeai*, had completed their 
third year-pf operation usir>g the replicatibrTof REPSAC. This replication ' 
was made by the Clovis-Portales Bilingual Early Childhood Program {€S£A, 
Title VII) vith* a training site -in-each school district (Clovis and Portales, 
New Mexico). Also, thjs training assisted the kindergarten program at Dora, 
New t'exico as well a.s assisted se^?era^ teachers- from various elementary 
schools in Clovis and Portales including one parochial school. The total 
number of tJje outreach participants during the year, who v/ere directly or 
indirectly affected by the advisory and training function, was approximately 
75. (Thi^ fiqure does not include the number effected .by the diffusion func- 
tion). ' . - 




acea of special education, s|)eech therapy, eaf IV childhood educa^tion, and 
bilingual Education. 




abi ' 
des' 

In'short, training was provided to teachers and aides at the replication 
centers, as v/ell •as at the parent center, in thfe-form of visits by the out- 
reach training .team using the Mobile, Learning Resource Center ^d by conduc- 
ting of a workshop at the parent center. The training visits to the replica- 
tion centers included a presentation bf a course (.Concept Development in Early 
Childhood Education divided into* 17 ynits) and demonstration of materials and 
screening orocedures. , ^ • ' ^ - • 



Needs Assessment . . . ' , 

Th§ first step in implementing .tHe advisory' and , training function v/as . 
to work v/ith the cpfimiunities, parents, and faculty/staff to develop coopera- 
tion/trust and assess training needs, and generally secure information so as 
to desigh an(5. implement a training program s6nsitiv^/to the needs of the 
parti cipan*ts. 
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A training needs assessment of the participating personnel was conducted 
usina the Early Childhood Training Inventory during August and September, 
1975!! The purpose of this inventory ^was 'two-fold: (1) To identify needed 
training experiences for teachers, aides, and administrators of early child- ^ 
hood programs; and (2) To identify preferences 'of future workshop participants 
concerning various modes of instruction. The summary and analysis of this 
needs assessment was oreoared by the evaluator in a special report dated Sep- 
tember 15, 1975, and these data were used as a basis for developing specific 
objectives of the training' program: The training began in October, 1975. 

w ' 

Research/Evaluation Questions 

As an element of the.evaluati'on of this training, the director and mem- 
bers of the outreach training staff posed several questions they wanted 
answered by the evaluator durirfg/a^'ter the training. The evaluation team 
used a variety of measures to collect data in answering these questions. 
- These measures included: objective evaluation of the training v/orkshops; an 
.objective test fDr the course Concept Development in Early Childhood^ class- 
. room vi^its.^f kindergarten classes only) using a specifically designed class- 
rpom observation form' site-visits with administrators, teachers, and aides; 
self-evaluation qyestionna ires from the trainees; and a reviev/»of various 
types of records maintained. by the training staff. The evaluation questions 
posed and answers found by the evaluation team are as follov/s: 

Q^l. - What kind of rapport exists between participants at the replica- 
tion centers ^ith'^he outreach training staff? 

^5 * "Based on iaformation obtained from -site-visits at the 
' * iHeginri'ing and at the end of the training sessions and from' • 
, selV-evaliJation questionnaires from" the trainees and their 
. administriator, much evidence was found which indicated an 
overall excellent rapfport between the two groups. ^ 

0 2. - Are uhe teachers at the replication, centers being supported in • 
their efforts by^their administration? 

Based on information obtained from site-vjstts at the 
• . beginning and at the end of the training sessions and from- 
self-evaluation questionnaires from the trainees and their 
administrator, evidence was' found to -indicate that the. teachers y , 
at the various centers beli^eved that they^v/ere being supported 
in their -Efforts by their a'dmini stration. The majority of the 
administrators viewed the training and results of the training 
in a favorable 1 ight,. especially the' part pertaining to the 
screening of the kindergarten children. ; • , 
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Q 3. - Do "the teachers have ^adequate availafellity. of professional 
materials in the areas of bilingual and early childhood education? 

During the sft.e-v.i?its at the beginniiig and'cit-tf^e end . 
of the trailing sessions^ the evaluatoV not.ed at each center , 

lack'of perfiianent materials (classrooms as well as profes- 
sional library) pertaining to bilingual education. However, 
teachers did--have access to su9h materials as' they cduld be . 
borrowed from the .%b'ile Learning Resource' Center. / " 

< • • • 

Q 4. - How effective was the teaching^of the coin-se,' Concept Devel«{5Jnent 
in Early Childhood, at the. various- repl i cation centers? 

.V. ■ • .■' , . ' 

This "course, divided into- 17 .units, was taug+it b)' the out- 
reach training team as they visited the repl ication centers. 
A total, of 34''peoDle enrolled for the course and werfe eligible 
. to receive credit from Eastern NewKexico Uhiversity. The 
course was to be evaluated by administering a pre and posttest 
and to conduct a statistical analysis of the difference between 
^' .,the mean- scores of the two tests; howeveK training was started 
before the.pre-test was .aditjinistered'.,. Consequently, the pr:e- 
test^sGQres -became invalid. The posttest was administered is 
. scheduled^ and the mean score of the -posttest was 28.9 (SD = 5.62) 
put of a possible 40. It was -concluded that the teaching of "the 
course was effective. * - . ' 

* 0 5. - Ar-e the teachers Using the -responsive, environment concept irt 
.their teachingiincluding. flexible room arrangement^ and' learning centers? 

Based on information obtairred "from site-visits at the • 
• beginning and at the end of the training "sessions and using 
~ the soecifically designed classroom observation form, a- marked , • 
' chance in teaching strateg.i.es was found, Several teachers had 
Questions aboyt the organi'zatiori and use of learning centers.. . 
■Differpnces.were noted "'by schoo,! , but overall, effects of the 
..training were obsjervable. . ' 

*0 6. - Do the teachers have a knowledge of handicapping conditions? 

Based, on the infoniiation .o*btained from* sftet-vis'its .vn'th 
certain teachers (kindergarten^), and .frorii the results -from the ^ 
self-evaluation questionnaires^^'from alUthe., teachers, they iri- 
' dicated a .relatively high degree of understanding of handicapping 
conditions.. . ' 
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• . Based on the in, " '° cM,d.e„? 

• ■i"9 chXV'l.'"^'^ Moh deVrn?" '"^ 'Sirs S '"^ 
V . ;. in ^he'^ea'^^'"^^^ cat"etl^"^i"S of'scTeen- 

.e„;e?.?--«ow...ec„..e.e.e.... ' ^ 

• • . ...a. ■ -t"- -.e. 

• ^5 follows; ^ ^-"'^ary Of thf7r3,;t^ ^ 

5ev ■ • f^esented 

narch 22-26, 1975. -T^ 12-36, Feb q°V^^ "^^k- 

Tf, ■• V- ' . ' 9-13, .23-27' 

'ne purpose of ' ' 

^ ----- sS^:- -^c.p^.||^-^ - 

T ■^nc1uded 4i T 5 P^^^-^^cf pants ^f^- . ' ' ' "•- ■ 

PffMcipant receded sfna*" ''''"^'-si^y: fir*'^.!''^' ^Sl iv'^'!" . 
36 received coUege^c,':.?.'''?"' "ist^^ct n?l",'"^ P^Moavlus " 
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/ Scale were v/ell above average (6-33-6*80 dn a 7-00 poiTit 
: scale), and the mean rating of the -Overall ^Effectiveness 

of the v/orkshops was 6*56* The narrative concerning the 
: observations of the workshop was very pos-itive* In short, 

the series of workshops achieved th6 objectives .and were 
• extremely successful . ' . ^ ^ 

Q 9. - Are the teacher-aides effective in th6ir role in the classroom 

Based on information obtained from site-visits at the . 
beginning and at the end of the training sessions, it v/as 
found a majority of the teachers believed that the teacher- 
aides v/ere effective in the classroom. Several teachers . 
did 'mention that v/hen teachers and their aides attended the 
same training workshop, there should be certain times v/hen 
the tv/o groups should b^ separated and appropriate activities 
be conducted for the differing needs of the two groups. 

QIO* - V/as the motpr coach. The Mobile Learning Resource Center, util- 
eff-ectively *in the training program? , * - 

The Mobile Learning Resource Center v/as used by the qut-- 
reach team as they visited the r^eplication centers* The motor , 
coach v/as stocked with materials for use of, the visfte'd. sites 
ahd included: ^ - • 

gooks for children; 12^ titles, Spanish a,nd£ngl>sh 

, . . , , • .* , \ '-'"'^ ' '-^ ' ' 

- \ . ^^Educationa'^' Activities; games:^. mu-lti; me4ia |c1ts and .e^ulp- 
. \ ment to help chiTdrfeh. learn specific -^ncepts or ski Us-' - 

— 69 .in Spknish and 'l;&3 in Efi$T45>^ '" V/.;' - / \ 

57 Curr.tculum Kits VnVbotb*§pan1sh andi-^^ . 

,Film<y:rips for tHTldrefft- 16 perceji:tual |ieVeTopnfent ^, ** • 

pa'ckages.v"?7 lahijiiage/retfding programs and' 38 othfers 

- • \:-; ^ ' ' ' , 

44.RecQrds for .Children.^ Spanish, Spanish and English,^ 
• . and English * 

73 Teaching Transparencies *; ; / * . . v 

82 Spanish and lOS'EngliSfV'Bdoks and Materials i'or 
Teachgrs and.Aides 
*" ' . ' < , . 

41 Films and Fil for Teachers, Aides and* Parents; 

14 Evaluation and Screening Instruments 



\ All of the above materials are available at no charge to 
the schools and teachers participating in the outreach- actlvi-- 
ties. The materials '.could > he checked out for approximately 
two v/eeks or until the next stop of the ftobile Learning; Re- / 
source Center. * " . 

During the 1975-76 school year, the. Mobile Learning Re- 
source Center (mc>to)> coach) was driven 12;384-miles' (personnel 
drove an addifToti^T 3,745 ri^iles in their personal automobiles 
on outreach business) and mad,e 14& visits to schools in New 
Mexico. Schools visited v/ere in Clovis (20 visits), Ft. Sumner 
.(33 visits), Artesia (30 vis-^ts), Pontales (10 visits), Carlsbad 
(42 visits), Dora (7 visits), Hobbs. (2 visits), and Farmington 
(4 visits). Activities conducted durin^the visits to schools 
included: the screening of chi^dreri,, tuning teachers and aides 
how to screen children, following though on the results of pre- 
vious screening, checking out ir\6 demonstrJfting materials and . 
attempting to provide whatever services teachers requested. The 
jKobile Learnigg Resource Team' provided ^v/eekly classes in .the 
course Early Childhood Education for 34 teachers in Carlsbad, 
Artesia, Rortales, Ft. Sumner, and Carlsbad. 

. ' During the year, tests v/ere administered to l,277*children. 
Of this number, 160 v/ere screened for speech and hearing defects; 
269 children v/ere referred for treatment; and approximately 42 
teachers and 48 teacher aides, v/ere trained in screening children. 

The evaluation team visited the schools servijfced by the Mo- 
bile Learning Resource Center and interviev/ed a number of admin- 
istrators and teachers. In every case, the responses to the 
5ervice and effect of the outreach activities were favorable; 
many stated that without the servtce of the Mobile Learning Re- 
source Center that they would l^e unable to help their handicapped 
young children. 

> 

Based on thes6 data, it v/as conducted that the motor coach 
was effectively Utilized in' the training function. 
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SECTION IVj 

EVALUATION DATA CONCERNING THE DIFFUSION FUNCTION 

✓ 



This function pertained to the dissemination bf information concerning 
the program activities. Some means of di-Ssemi nation included: workshops, 
conference?, preparation of a commercially prepareo^ 16 mm film, .and prepard- 
.tion and distribution of various brochures and reports. 



Workshops/Conferences 

Five v/orkshops/conferences v/ere conducted during the year as part of 
this function, as well as advisory and training. Evaluation data of these 
workshops v^ere reoorted in a separate report, and submitted to the project 
director i^isBediately after each workshop. The workshops were evaluated using 
the McCallon Workshop Evaluation System which was described in Section II. A 
summary of these reports is presented in the fall ov/ing. paragraph. 

First Workshop >- ENHU 

The first workshop. Workshop on Implementation Procedures on Early Pre- 
vention of School Failure, was conducted at Eastern New Mexico State Univer- 
-sity. May 28-30, 1975. This workshop was conducted by a dissemination team, 
from the Early Prevention of School Failure' Program, a nationally validated 
ESEA 'Title III projegt, located in Peotone, Illinois. - 

V 

This workshop, focusing on kindergarten age children, .was designed to 
provide school personnel knowledge and skills necessary to implement screen- 
i-fig" programs in their Tesoective schools. In addition, the workshop attempted 
to assist the participants in the planning of educational experiences for 
kindergarten children v/ith certain developmental lags. Specifically, the 
workshop participants. were expected to: 1) Acquire the skills necessary to 
implement a screening rtodel for kindergarten age children; and 2) Develop 
strategies designed to meet the unique^ educationa.1 needs of earh child. 

, A total of 84 attended the workshop which' included teachers, teacher- 
aides, administrators, and related school personnel (parents, university 
faculty, and students). The participants represented the school districts 
(New Mexico) of: Portales, Clovis, Ft. Sumner, Carlsbad, Elida, and Dora., Of 
the total participants, 53 received college credit (1 s-emester hour) for com- 
pletion 'of the workshop through EflMU.^ " . 

Using the McCallon Workshop Evaluation System (See Section II), the mean . 
ratings on the seven dimensions of the Workshop Evaluation Scale were well 
above average (6.73 - 6.30 on a 7. -00 scale), "and the mean rating of the 



Overall Effectiveness of the workshop^vas 6.60. The narrative concerning 
the observation of the workshop was very positive. Also, perscmal coments 
from the participants indicated a high degree of satisfaction. 

$e.cond^ Workshop - ENMU 

• * The second -workshop, Early Childhood Bil ingiiaT/Bilcultural Education: 
Why and How\ .was conducted at Eastern New Mexico State University, August • 
-t8-2,0, 1975. This workshop was cojiducted by three facitUy members of the 
Metropolitan Stat6 College, Denver, Colorado/ 

This workshop, focusing on kinderg^rtep age children, was designed to 
Drovide teachers and teacher-aides knowledge and skills necessary to imple- 
ment/imprrove programs in early childhood bilingual/bicultural education..' 
Some topics of the workshOD included: Introduction to Bil ingual/Bicultural 
Education: Cultural Activities for Classroom Use; Implementing Bilingual ' 
Activities in the Classroom; Lear-ning Centers; Developiag Oral Langi/age: and 

Professional Developi^ent. ' . , ' 

' _ . 

A total of 44 attended the workshop which included teachers, teacher- • 
aides, and administrators. The participants represented the school districts 
(New Mexico) of: Portales, Clovis, Dora, and one parochial school in Clovis.p- 
Of^the total participants, 42 received college credit (1 semester hour) for 
comoleting the workshop through ENMU, 

■ . . ■ ■ . . . 

Using the McCallon Workshop Evaluation System ^ee Section II), the mean 
ratings on the seven dinensions of the Workshop Evaluation- Scale v/ere well 
above averaae (5.90-6.60 on a 7.00 scale), and the mean. rating pf the Overall' 
Effectiveness of the workshop was 6.40. The narrative concerning the "obser- 
vations of the-workshop'was very positive. Also, personal comments from the 
participants indicated a high degree of sati-sfaction. ' 

- ■ % 

Third Workshop - Carlsbad , ^ ■ 

The third viorkshop., Carlsbad Workshop on Implementation Procedures, of . 
Early Prevention of School Failure, was conducted December 1-2 arid 6, 1975 
at the Carlsbad Head Start Center, Cafl^tiad, New. Mexico, This workshp|f^vas 
conducted by a member of the disseminatio)i team from the'Early Prevention of 
School Failure Program, a nationally validated ESEA Title III project, loca- 
ted in Peotone, Illinois. • ' ' ^ 

. The workshbp was designed to train school personnel in.*<ie ski«lls neces- 
sary to implement a method of 5<(reening kindergarten age children relative 
to pre-academic skill s,>rr the areas of auditioo,. language* vision, speech, 
"motor development, attitudes tov/ard learning situations, and^emotional or 
'social factors Whi^h could cfffect ability to profit from school experience. 
The workshop also assisted the participants in the planning of educational 
experiences for Jiindergarteh children with certain developmental lags. 



18- 



' A total of 39 attended the workshop which iincliided teachers, teacher- 
aides, administrators, and one school nurse. The participants represented 
the, school districlJs (New Mexico) of: Car1s6ad, Artesi_3, and Clovls. Of 
the total' participantsi 19 recf1Ve<F credit (1 semester hour) for completing 
the workshop through ENHU. ^ . ^ * / ' ' ' 

. Based upon data obitained with the McGallon Workshop Evaluation' System, 
It was evident that the^ workshop v/as/extre'feeTy Successful . ' Participant . 
reaction to the workshop goal^objectiv^"' vras vfery favo/atfle, and the»majorv" 
ity of .the personal comments indicated .a hfgfj decree of satisfaction with ' 
the v/orkshop. ■ -' " '.^ ■ - - ^ . ' ' 

^ . ■ 'hr.. ' ^ 

^ Using the McCal Ion Workshop Evaluatfon Systena '(See Section II), the 
mean ratings on the seven dimensions of the WoHs^iop Evaluation Scale v/ere 
well above" average (6.10-6.70 on a 7. dO. s.cal^) ,'Vnd; the mean 'rating of the 
Overall Effectiveness of , the works^iop was'.6.70. Tfie 'narrative conceY^ning 
the observations of the workshop was, \?ery positive. Also, perrsonal comments 
from the participants indicated -a high degree of satisfaetlon* . 

Fourth Workshop - Farmington ^ ' . ^ ^ . ■ ' • 

.-.'."'•- t: ' . • 

the fourth workshop. Early .Childhood. Education.: Why and How,^as con- 
ducted Aoril 5-6, 1976 at Farmington Head Start Center,. Farm in gton, ffew , 
'Wex,ico» This v/orkshop was conducted^ by the .REPSAO outreach training staff 
using the Mobile Resource Learning Center^ ^ ;' , ,< ,' ^ . 

• The purpose of this workshop v/asjio provi^Je the staff of the Farmm^tbB. 
Head Start Project vith training' rel an ve to the identification a'nd vo'rkfng ; 
with, young handicapped children. , ' - ' ' 

. A total of 25-.att^ded the workshop which 'included .teachers, teacher- . 
■ aides, and administrators. • : ' . - . 

. , '' ...J.. ^ 

. .Using the McCallon Wonkshop Evaluation -System (See Section Uj, ilii f;J ^ 
mean ra'tings on the seven dimensions of the/ Workshop Evalliatio.fii$&le s^re.:':,.^^^V^^^ 
'-.well above average (6. 58-6.. 88' on a 7.00 scaTe),'and the meaVfVrAW.nJ -Of .*hf'.!:;X.^ 
,. Overall Effectiveness of the workshop' was 6.88., The nawfatfyfev.cipifc^l'fii^^^^ 
• the observations of the' workshop was yg^ry positive... AliW ^ejfspTj'^T'co}^ 

from the participants indicated a high degree of satis,tapr<iOvt.X\\- ■-'V,;?-*^^^^ 

Fifth Conference ^ Albuquerque - >" } ■ . ! 'V^^^ 

— " ' ■■ ■ -'i .. "iv ^?n-^''-'"'^'-v.-''^'"^r'V.<\,'^.??^;^^ 

The fifth conference. Early Childliood'EWcstWtQ.TtjE'^r^hce',,^^^^ 
ted in Albuquerque, New Mexico,' April .prm^; f ; ■Amt^.Jiij^fi^PM V.- l.^^i 

component v/as co-sponsor of this conf^i^j^iKe.v/}|i'c|i was. 
mately 200 ■ ■ • • • - ■■i' i . - -.i- 4^..- 

Mexico. 
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outreach training^iaiff who presented information and various training ses- 
sidiis. flso, ^6re were representatives in attendance from eight nationally 
validated Ti^Te III early education programs. In addition, the conference 
participaafes drafted a resolution pertaining to state government support of 
developipent of eairly childhood education which v/as. later presented to the • 
Governor at The People's Forum-on Education on May 21-^2/^1976 In Albuquerque. 

y • The. purpose of the conference v/ag: 1) To provide planning assistance to, 
administrators who are responsible for kindergarten programs; 2) To provide^ 
training in a variety of approach§s to teachers and adriiinistrators; 3) To 
provide techniques and approaches to indentifying and mainstreaming young 
handicapped children; and 4) To draft a resolution pertaintng to state gover- 
nment support of development of e^rly childhood education, f 

A total of over 200 attended the conference at one time or other: and 
apprpximately 57 attended the training sessions conducted by the outreach 
trafni/ig staff, » ' * 

Using the McC^llon Workshop Evaluation System (See Section II )» the mean 
ratfncjs on the seven dimensions of the Worksjiop Evaluation' Scale were well 
above average (6.23-6,63 on a 7,00 scale), and the meanVatitig of the Overall 
Effectiveness of the workshop was 6,63. The narrative^concerning the observa- 
tions of the v/orkshop v/as very positive. Also, personal comments from the 
participants indicated a high degree of satisfaction. 

Summary of Narrative Comments on Workshop/Conferencest . 

•As par.t of, the McCal^on Worksjiop Evaluation System, the participants 
often mad? narrative comments concBrntng the strong and v/eak features of the , . 
^ v/orkshop/confererice, ,.A representative sample of such comments are as follov/s: 

Strong ^Features ' . ' ' * , ' ^ 

1. ^ Purposes clearly presented ^ . 

2. Explanation of screening proceduTres ' ^ ' 

3., Participant involvement ' ■ / * ' ^ ' 

' 4. Best v/orkshop I ev4r attended . i 

5. Presentation on culture * - , 

6. Excellent ideas for classroom .use - _ , ; 

7. Materials v/hich v/6re distributed . \ 

.8.^ Becoming, familiar with good material s$ • ' ^, ^ / 

9, Small giJDup and explanation, of the^ifferent tests , 
' 10. ^ Organization, presenters, and pertinal infohnation 

Jl, Findiilg put about' the National Diffusion Ne,twork and the 

different projects r\ ■ ' • , ' ' 
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Vfeaker 'Features • . . - • -.' 

Not enough time 
Hot enough smalLgroup work 
More practice fn administering screening tests 
Nat being able to v/ork enough with children 
Not. enough sessions presented in Spanish 
bod lousy and too expensive 
. Not enough materials demonstrated 
More explanati6n on scoring and .interpretation of tests 

"Oth er Dissemination.Activities . I 

. ■• ■ ^ f 

• Other types of information concerning the outreach activities were • 
disseminated hy sueh means as described in the following' paragrahps. , 

Over 5,000 cc/ies of the brochure, "Parents: Do You-Know the fariy Warn- 
ing Signs of Children. with Special Needs," were distributed in the vicinity 
'Of the replication 'centers of Ft. Sumner, Carlsbad, Artesia, and Dora. . 

/ . The development of 4ix 1 minute video cassette spots for use on televi- 
sion. These were developed. in cooperation v/ith KENW-TV, ENMU, and they were 
presented to the Governor's Commission for Public Broadcasting in March', 197-6. 

Members of the' outreach training team made presentations of the project, 
including^ooTrecTch to": the annual meeting of the New Mexico Speech and Heiring 
Associiation at E.NMU, Portales, April, 1976; various classes in Child Develop- 
ment at EHMU; and to the EflHU chapter of the Council for Exceptional Children. 

* 

• ' A 15 HOT, 28" minute color film, was commercially prepared' s"tf as to dissem-. 
- inate information concerning the program as well as for use i^i. various in- 
service training |>rograms- 

pThe project used student teachers .from nearby Eastern New Mexico Univer- 
sity and thereby disseminated information through ttie university- " • 

Progress reports were submitted to the local central administration 
office, school board, local iirea news media including nearby Cannon Air Force 
. Ba^e,.'the State Department of Education, the U.'S.'Office of Education, and 
. the U'.Ss' Senators from New Mexico. /| ^ „ ■ . 

Site visitation by many professional individuals and. groups as v/ell as 
^-^arents. ■ ■ ' . ' 

Also, much pufilicity was received, when ttie„project received an fnvita- , 
tion from the National t)ij"fusion Network for , the CI ovis program to serve as ■ 
a national demonstration site for the Early Prevention of School Failurp 
Project of Peotone, Illinois. / , 
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SECTION VI ' • 

STRENGTHS AND WEAKNESSES OF THE OUTREACH ACTIVITIES 



Another measure used in the evatuation process of th^ outreach ^ 
activities during the year v/as for the evaluation team members and the 
outreach .training staff to list the, strengths erhd weaknesses of the 
outreach activities ^as they perceived them. The following represents 
a summary of such lists. 

• Strengths * • - ; ^ 

1. The outreach training team's true dedication and commitment 

in their .efforts to assist teachers and aides at the various replication 
sites; ' ' • • ' ' 

* * 

2. Provided opportunities for many teachers to. see and receive 
i.nfonnation about -a wicje variety of early childhtfo^ and bilingual 
materials as well as an opportunity .to check out materials for class- 
room iise. . «^ 

! 3/. The Mobile' Learning Resource Center (motor coach)- which gave 
the project the capa'bility to take the needed, training to the replication 
centers which are located in isolated areas of eastern New Mexico. 

4, ' Provided excellent in-serv,ice training for the Head Start Centers. 

5. Provided a catalog of appropriate materials and address of 
publishers concerning early childhood and bilingual education. ' 

. " 6. Provided excellent on-site training during the series of sevfen 
workshops at the parent icenter which involved Head Start personnel, 
kitidergarten teachers, special education .teachers, Jjid teacher-aides.. 

^ 7' Disseminated, needed inf&rmatiqn conceAiihg the identification 
.and ne^ds of handicapped children. 

' ^ 8. Provided resource people and. specialists which the^various 
replication sites did not have v/ithin their systems. ^ 

9. Provided teachers at the replication sites (fsolated areas) . 
with &n opportunity "tq take ? college course in conjunct jon v/ith in- 
service training. 

^10. • Provided resiurce and suppprttve cl^ss^oom materials for' the ) 
te&chers and' instru'ctors qn how to use them.* . 



29 



Weaknesse s ( \ ' ' \ 

! \ ^ \ ) -» • 

lA 4 ' \ ^— • / 

!• Tl^inabilili^ of^utreach to formally cqimiit training services 5-* 
to the replvdation sites, as. well as other-schoolls, because of the delay ' 
of BEH 9^ttiM the project, funded on. time. A related^ weakness is the 
"^'funding of Igjfe project ;is not by gdverHment fiscal ye^r-or even .school 
year. The funding is Jan • Jan which puses many edmijii strati ve problems,*]^ 

« . \ tf^ ' 

2. Outreach tried .to accpmplish too muchMn Such a short period of ^ 
time. ^ . . 1 ' r:; 

3. Absence of a long-range, planning schedule concerning the use ^ 

of the'motqle coach as>well/as a systematic Vay of necording dati concerning*' 
the use of the coach.* ' 



SECTION. V . ' 

FOLLOW-UP '^UDY OF FflRI^lER REPSAC 
^ STUDENTS: 1971-1976 



The 6asTc. assumptions on which early intervention programs is b?§^, 
'such as REPSAC, .is that stimulation for'*childrei> who' possess characteristics 
not conclusive to schodl achievjement v/ill Jncrease their chances of ^icnieving 
in the regular^ school program/ REPSAC, a planned intervention program f-^^ 
"high risk" Spanish-American pre-school children, ^las developed and na£ 
joperatirtg t-o offer 3-, and 5-year-old children educational and social 
stirniflation designed to assist them to- achieve in school f 



for 
been 



, Purpose 



he 



The purpose of this follow-up study is to test this assumption in 
case of children who attended REPSAC during the years 1971-1974. More speci- 
fically, the study attempted to answer the following questions 

.1. What- type of changes in learning aptitude, language develdpme it in 
English, ^nd language development in Spanish have pccurred-ifr^)m 
time of entry into .REPSAC to the end of the regular school yeir ' 
1975? ^ ^ . . • ' 

•2. What is the status of former REPSAC students v/ith regard to; 

a. Grade placement ' ^ ' ^ 

b. Promotion/retention 

c. Special assistance ' ^ - ^ 

3. Ho;v do teachers view former REPSAC stu;lents v/ith regard to: 

• a. Academic performance 

^ b. Social adjustrrtent * 

c. Overall School Performance 

d. Major strengths and weaknesses 



' ' . Subjects 

•.,Sdt)jects for the study were 29 former REPSAC students currently livfng 
and'attendirig school in Clovis, Nev/ Mexico.-' Of the 29 subjects included in 
th'e study, 11 were fji the second' grade, 14 iif" the t)iird grade, 1 in-the 
fourth grade, and 3, in special education* ^ ' T", 
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Procedure 

The procedure for this study consisted .of the foTlov/ing steps: 

1. ' Identifying the former REPSAC students fay location and grade 
, level. This, step v;as accomplished by the project staff, 

^ • ""'^ ' . 

2. Conducting a questionnaire survey of teachers- This was accom- 
plished by a member of the evaluation team. Personal interviews ■ 
v/ith teachers of former REPSAC students, were also concluded by a 
member of the evaluation teajn. . ^ • 

3. Testing students who were. in the second, , third, and fourth graded 
The instruments used were the same as those used in thr previous 
evaluations of REPSAC. Jhe tests used were:- the Hiskey-Hebraska 
Test of Learning Aptitude' and the Peabody Picture Vocabulary Test 
(English and'Spanish versions). 

Data, v/ere alanyzed by descriptive measures and by use of a trend ana- 
lysis. ^ / ■ 

• 1 ' . Findings . . 

Jfie findings of this study were as follows: 

1/ Test performaifce of the former REPSAC students tefted indicate 
that: . 

a. / Learning 'aptitude scores (IQ) have remained^ relatively sjable* 
, ' \ from the initial testing in the Fall of 1971 to the testing 

in the Spring of 1976- The largest increase occurred folldv/ing 
the first year of interventions. ' ' 

• ; 4- ^ • ' / 

b. Language ^ieyeloDment scores in English gained substantially-.^ 
' r. //• after the. first year of intervention and agafn at the end of 

the second year of 'intervention. From the REPSAC exit point 
. • in the Spring of/l973, scores have tended to remain stable. 

• c. Language development scores in Spanish show the largest inr 

crease at the end of the second year or interveni:ion. A 
■ * rather substantia^ decrease v/as noted from the REPSAC exit 
ppint in the^ Spring qt 1973 to the Spring, of 1976,: These 
data are presented in Ta1)le 1. * . 
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TABLE 1 

MEA« TEST SCORES 'of FORf-lER REPSAC 
STUDENTS . 1971-1976 • 



TEST 


. TALL 
72 • 


SPRING 
■72 


FALL 
72 


■SPRING 
73 


SPRING ' 
75 


SPRING " ' 
76 


HISICEY 
(IQ) 


. 89.00 


■'■98.71 


94.64 


99.45 


99.65 


- 92:10 


PEABODY 
(ENGLISH) 


27.82 


'ri'.94 


40.45 


59.82 


60.82 


63.55 ^ 


PEABODY 
(SPANISH) 


15.94 


28.53 


28.09 


66.64 


. 59.76 


B8.45 



d. The time-series analysis of the data indicate that the 
trend set in terms of past performance is departing sub- 
stantially from the expected grov/th pattern toward a 
dov/nward trend for 1-anguage development in Spanish, a 
sTIghtly upward trend for language development in English, 
and a rather stable trend for learning aptitude. Figures 
1,2, and 3 present these data. - 



/ FIGURE \l 

/ • ' .•■ . ■■ 

LANGUAGE DEVELOKIENT SCORES IN SPANISH OF FORMER EEPSAC 
STUDENTS. 1971-1976, ORIGINAL DATA AND TREND Lg?E_. 




FIGURE 2 / / . ' . 

LANGUAGE .DEVELOPMENT SCW^S IN EJGLISH -,OP*tefeffiR 8EPMC - 
StUDEjJTS, 1971-1976.. 'ORIGP^M. DATA AND TRENB LINE 
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4: Original Data 
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TEST DATES F"?! Sp-72 ' .F-72 .Sp-73 

REPSAC ' REPSAC. .. . 

Intervention Period 



Sp-75 
G2-3 ' 



Sp-7,6 
G3-4 



- \ 



Public School 
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i FIGURE* 3 - 



LEARNING APTITUI3E SCORES OF FORhffiR' REPSAC 'STUDENTS,. 
' i971-I976, ORiqiKAI^ DATA AND TRENP LINE . 




2 J the data indicate that 26 (90%) of fqrraer REPSAC students, are in 
/ regular classrooms and 3 (10%), in special education classes. 
. Three of the 23 students in regular classes were retained and 
only 3 of the 26 students in regular glasses have required 
special assistance. These data are presented in Table. 2., 



TABLE 2 . 

CURRENT STATUS OF FORMER SEPSAC STUDENTS 



STAlbs'' 


TYPE 


NUMBER • 


" PERCENTAGE 

( — 


GRADE PLACEMENT ^ . 

* 


REGULAR 
SPECIAL 


26 
3 


90" 
10 


PROMOTION/RETErfTION • 


PROMOTED 
RETAINED 


23"" 
3 


88 
12 


SPECIAL ASSISTANCE 


YES ^• 

" NO 


3 
26 


10 
90 



Tables 3,M, and 5 present the results-^f teachers^ views regarding 
acadeniic performance, social adjustment, anct' dVerall school performance of 
former REPSAC students. As noted in these'tjables, the majority^ of for;mer 
REPSAC^students v/ere rated in the middle one-third or above on academic 
perfoniiance and social. ^adjustment and. average or above on overall school 
performance. ' ^ 



;; ~ TABLE 3 
TEACHER RATINGS OF FORMER REPSAC . 



4 


STUDENTS ON ACADEMIC PERFORMANCE 


RATING CATEGORY 


; NUMBER 


PERCENTAGE. . 


UP^ER ONE-THIRD 


• ' . ■ 5 


19 ,•■ 


MIDDLE ONE-THIRD- 


• '14 


54 


LOWER '-ONE-THIRD^ 


'■ — '■ — r — 


27 , , «. ■ 



37 " 



*- 


X 


t 


TABLE 4 ■ . 
f 

TEACHER RATIfIGS OF FORMER REPSAC STUDENTS 




ON SOCIAL ADJUSTMENTS 




RATING CATEGORY 


NUMBER 


PERCEmGE 


UPPER ONE-THIRD 


10 


38 


MIDDLE ONE-THIRD 


12 


46 


LOWER ONE-THIRD 


3 


12 




TABLE 5 




TEACHER RATINGS, OF FORf€R REPSAC STUDENTS 


ON OVERALL* SCHOOL PERFORMANCE 


RATING CATEGORY 


NUMBER 


PERCENTAGE 


• * ' ^'^r:^ ^ 

GOOD 


■ , ■ 10 


38 


AVERAGE , - 


10 


38 


POOR 


6 

* 


24 



30 



* Teachers were asked, to rate each student f n terms of 
overall performance,i^e. , motivation, v/illingness to 
learn-, attention, and academic progress'. 

Conclusions 

. — - K 

Frbni' the. data obtained and^^ analyzed for this study, the fol.lowing'" 
coDC.lus^ions appear warranted: \. 

' . ' , . ■ . ■ \ . * • 

i'.. In general,' fprmer REPSAC students are performing very well in 
' the regular school programsr: -The majority of the students? TraVe 
follov/ed regular, grade pTademenft, been promoted, required no ' y 
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* special help, were rated by^toeir teachers ifi the middle one- 
third of their class on academic performance, 'v/ere rated by \ 
their teachers in the middle'pr upper one-third pf their class 
on social adjustment, and v/ere, rated as average on overall * 
schoor performance. 1 . '\ . • 

" y 2. Based on the test iriformatiorj and analysis, a trend toward a 
substantial decline in Spanish continues, a slight increase, 
' ' but less than normal in language ability in English can be 

expecteds and a definite leveling of measured learning aptitude 

- seems apparent. • ' ^' ' 

Discussion 

It should be notecl that the performance of former REPSAC students can" 
be interpreted more accurately by considering theirv^tuatiohs at times of 
--^ntry into REPSAC. The mean.IQ of this group was 89700 with^ English artd 
Spanish scores of 27, 82, and 16.-94 respectively. This low performance 
1-evel, along with other personal and social characteristics, placed these 
children in a "high risk" category^ with respect to School' survival . Con- 
sidering this-, the achievement^of these children in 1976 is qjuite remarkabl 
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. . SECTION yil 

IARV , FINDINGS , /CONGLUS IONS , AND " k^COJ^fCNOATlQKS 

' .... ; • ■ . '■■ 

' ' Summary . ; ^ \ ^ • 



.Beginning with school year 1975-75, the otitreaqh activities. coinponer>t ' ^- 
was added to the parent center (REPSAC) to give the cen-ter the'capabilityof 
providing replication services to various local education agencies requesting 
such, services. A unique feature of this replication service'was the .capabfl- ^ 
ity of taking the training' to the replication centers by a specially designed 
and equipped motor coach, Thd Mobile Learning Resource Cenfer, 

The outreach component v/as implemented in. two phases. 'The first phase 
consisted of needs assessment and developmental planning (November 29>, 1974- 
August 31, 1975), and the second phase consisted of th^- implementation pro- 
cedures (September 1, 1975-June 30, 1976). . . 

Three school districts, aTf^in isolated areas and haying a. large number 
of target children and within a reasonable distance of the parent, center, re- 
quested replication services during, the. 1975-76 school year. These schopl 
districts were: Fort Sumner;' Artesia; a^nd Carlsbad, all located in eastern 
New Mexico. Jn j^ddiiion, replication by tv/o 6the^ school districts had al- . 
r^ady been completed. This replication was* made by the ClQVis-Portal€s Bi-,**^ 
lingual Early Childhood Program (ESEA.,. T^itle VH) with a training site in ' 
each school district (Clovis and Portales, New Mexico). 

I Training was provided to teachers and aides at the replication centers, . 
a5 viell as at the parent^center, in the form -of visits by the outreach- training, 
tbm using the Mobile Learning Resource Center and'by conducting a workshop' at* 
tie parent center. " The training visits to the replication centers ihclfUded a; 
prejentation of a course (Concept Development in Jariy .Childhood Education 
divided in 17 units) and demonstratfon oT materifflP'and screening procedures 1; 

The outreach activities were generally .classified into two major func- 
lons: advisory/training, and diffusion. ' * 

The evaluation design for the advisory and training function. mainly 
onsisted of 10 research/evaluatipii questions. •'To answer these questions, .a 
a:y*iety of measures were used which JndlCided: objective evaluation of the ' 
training v/orkshops; objective evaluation o.f the course Concept Development 
Jn E§rly Childhood; classroom* visit^^ (all kindergarten classes)j^irtg a. . : . J 
specifically designed classrQQm observation form; site-visits v/itn adm^l11stra-• 
tpr$,•*teachers, and aides,; self-evaluatjon que^tjonnaires'-from.ttte trainee^ 
a^jl trainers;' and a review of various types of records/logs. maintained by the. , 
•outreach training team. • 



- The evaluation, design for tffe diffusion function consisted of objectively^ 
evaluating .the workshops/confererices and subjectively e'vaTuatijig -the other 
jiissemination acti.)$ities. \ . . ' • . 

.1 * • . ♦ " 

In addition, th^i^.^evaluation study consisted of a follow-up^pf formfei^ * ' 
REPSAC studentsjihoHr/ere, this year, in*grades 1-4. ' ^ • , . 

^ / Findings' , ^ . • - ^ ... 

* -j^ - 

The major /findings of this evaluatiop study^ including the fbllow-up 
study 'of former ^REPSAC students, were:, % 

The needs assessment, E^rly Childhood Training Inventory, provided 

adequate data for developing dbjectivps for .the training^ program. 
« * ' * * * ' * . 

2. ^^Excellent rapport _exis^tecf between the outreach training team and^ 
the -teachers and,aides»at the replication centers. r . ^ ' 

•* * \ ^ • . ' ^ , ^ ' ' • • 

'^^J-. / A lack pf permanent .(pi assroom materlaTs^a$. well as ^professional 
libif'ary^b^naterials pertaining to bilingual education was evident at the re- , 
pi idatioT/ Centers. , . * , 

. 4. Although' the |3retest/tores of the test ovec tlie cpurse Concept 
Development in Early Childhood^v/ere invalid, it v/as fj^|Jn4»that |Ke teaching, , 
•of the course v/as effective. ' ^ ' ' ^ ^ • 

' 5, ^ Teachers trainee! at the replication centers hac{ a good understanding 
ef* handicapp^ing Conditions and knew how to adequately screen their children, 

V • - /< ^ . 

6. The'.teacher-aides at the replication centers'v/ere considered4i)y 
their teachers as being effective and useful in*lhe^ role^in the classTOom. 

Z^/*^l!!$^3i"'^"9 V/orkshops conducted at^e parent center had a positive 
effect on the teaching behavior of . the paVticipants as^well 'as being considered, 
extremely effective by the participants. . • , 7 



8. • The motor coach. The Mobilg Learning. Resource Center, was utilized 
effectively in the training program. The coach v/as driven 12,384 miles ^{plus 
an additional 8,745 miles driven b^ personal auto) while making 148, training 
visits to. the replication centers.- \ . ; . _ « 

9. ^ The workshops/conferences (ENMUj^ay 28-30,- 1975; ENMU, August 18--^ 
20, 1975"; Carlsbad, December 1-2, 6, 1975'; Farmington, April. 5-6, 1976: and 
Albuquerque, April 29-May 1, 1976') as part of the diffusion function, v/ere 
v/ell conducted and considered extremely effective. by the participants. 



10* ' In addition to the workshops/conferences, the other dissemination 
activities (brochures, media releases, film., reports, presentations, and 
visits to parent center) were found to be more than adequate for the purpose" 
designed. . . 

11. As pertains to tf|5 follow-ufl study, test performance' of former * 
REfSAC students who were; this^year,, in grades 1-4 indicated that: 
♦ 

. a. Le^irning aptitude scores (IQ) Have remained relatively stable from 
the initial testing in the Fall of 1971 to the testing in the Spring of. 
t 1976. Tlie largest increase accrued following the^tirst year in the 
^ intervention. - ^ . ' ■ - 

b. Language development scores.. in English gained substa/itially after 
•the first year of intervention and again at the end of the second year 

of intervention. From the REPSAC exit point in .the Spring of 1973, ^ 
scores have tended to remaio stable. > ' * ' 

c. Language dev^opment scores in Spanish show the largest increase 
at the end of the second year of intervention. A rather substantial 

^decrease was -noted from the REPSAC exit point in the Spring of 1973 to 
the Spring or 1976. 

' d. The time-seriesSanalysis indicated that the tr^nd set in terms of ^ 
past performance is jreparting' substantially from the expected growth 
pattern tov/ard a downv/ard tr'en'd for language development in Spanish a 
slightly upward ^rlnd for language development in English, and a rather 
stable trend for learning aptitude. . . ' - 

e. It'v/as found that 26 (90%) of former REPSAC students were in regula 
• classrooms, and^(iOA) ,in s&pcial education classes. Three of the 23 
\ situdents in regular classes v/ere retained and, only 3 of " the 26 students 

in regular classesjjave required special assistance. 



Conclusions 

Based upon the findings of this evaluation study, the major conclusion^* 
v/ere: ' ' • 

.1* The, advisory anjl training function of the outreach activities ^oper- 
ated as generally planned' and v/as extremely effective. It v/as very obv^ioujs 
that this training, with the services of the Mobile Learjiing-Resdurce Center 
made it possible for the replication center to assist thei^ young and handi- 
capped children, Without these services, such^^assistanc? would have been 
impossible. . - ' ♦ • - 
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2. The/ diffusion function provided the nece|lary dissemination -of the 
outreach actyvities.. ' 

3. Inf general, former REPSAC students v^ere 'performing very well in the 
regular/schpol programs. The majoirity of ,the students have followed regular ' 
grade placeinent, been promoted, required ^no special help, were rated by their 
teachers in the middle one-third of their class op academic performance, were 
rated by tiieir teachers jn the middle or upper one-third of the class on 
social adjustment,* and Mere rated as average on overall school performance! 

Based on the test information and .analysis, a trend toward a sub- 



stantial^ decline in Spanish continues, a Slight increase, but Ifss thafi 
normal^ 

ing of iiJeasured 



•in language ability io English can be exj^ted, and a definite 
leasured learning aptitude seems apparent. 



level- 



5. Members of the^oQtreach t^raining team were very je^icated and com- 
mitted to their assigned task. ' . ' ^ 

6. Althougli' it was obvit)us that may problems 'were encountered .and* that- 
all personnel' associated with the outreach activities experienced many frus- 
trations, ample evidence v/as found, to cgriclude that the outreach activities 
component functioned as planned and in accordance with the approved proposal 
document during the period November 29, 1974-tJune 30, 1976. ^ Also, it v/as 
concluded that the capability and effectiveness of the outreach activities 
v/as instrunentcil* in the parent center (REPSAC) receiving an invit'ation from 
the National Diffusion Nefv/ork for this program to serve as a^ national demon- 
stration site for the Early Prevention of School Failure Project. In short, 
accomplishments of 'the outreach activities duriag 1975-76 v/ene remarkable. 



^ ' . ' ' . Reconmiendations ' ' ' 

' Based upon observations, site-visits, findings, and conclusion of this 
study, the "-foil ov/ing 'Suggestions' or recommendations are made:/ 

1. Tliat the funding period of the outreach activities -component be 
adjus^ted so/as to correspond with the dates of the .school year rather than 
on a loose caT^ndar yeaf* basis. ' [ ' ^ * . 

2. That future outreach training include additional emphasis on.l) 
development of specific instructional activities after screening; and 2) 
guidance in development of more teacher-made materials* 

^ • ' 3. .A systematic v/ay be developed for the outreach training team to 
record data concerning the use of the motor coach. 

4* -That the Kindergarten' Implementatioh Guide^be continued to be 
developed so a's to be used in various trainings-activities. 
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5 . .That 'neasures be taken t .^ bet^-een^dnrectan^ ^ 

That tfte follow-up |t^:'^°y;,rthe . . • 
to'^a.. a,U on tHe - ,,,el.P ana . . 
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